Network optimization in railway transport planning

This work is dealing with train timetabling problem. In the first chapter, one can find an introduction to network flows which is needed for understanding deeper concepts later on. Namely, basic graph theory definitions are stated as well as core problems like the minimum cost flow and shortest path problem. Furthermore, two equivalent representations of network flows are described, including some useful properties connected to each of them. At the end of the chapter, linear programming and simplex method are introduced into some detail. In the second chapter more complex theory is introduced. At the beginning, multi-commodity flow problem is stated and few solutions approaches are briefly described. Once we settled for one of them, the rest of the chapter is dealing with Lagrangian relaxation and column generation techniques. Since column generation is the main result needed for solving our problem, some finer results, like determining lower and upper bounds, are stated. In the last, third chapter, one can find a model for representing train timetabling problem for a single line network. That model was introduced by Valentina Cacchiani in her Ph.D. thesis. In this work, periodicity of timetable is assumed because it makes computations way quicker, as well as it has some other benefits. At the end, one can find an algorithm based on column generation technique for solving introduced model. That algorithm is based on 6 steps, and after reading this work, one should be able to fully understand each of them.Ovaj rad bavi se problemom rasporeda vožnje u željezničkom prometu. U prvom poglavlju nalazi se uvod u mrežne tokove koji je potreban za razumijevanje naprednijih koncepata. Konkretno, iskazane su osnovne definicije teorije grafova kao i neki temeljni problemi poput problema najjeftinijeg toka i problema najkraćeg puta. Nadalje, opisana su dva ekvivalenta prikaza mrežnih tokova, uključujući neka korisna svojstva za svaki od njih. Na kraju poglavlja, linearno programiranje i simpleks metoda, objašnjeni su na razini razumijevanja. U drugom poglavlju nalazi se naprednija teorija koja se nadovezuje na prvo poglavlje. Na početku poglavlja prikazan je problem više dobara, kao i nekoliko pristupa rješavanju navedenog problema. Nakon što smo se odlučili za jedan od pristupa, ostatak poglavlja bavi se Lagrangeovom relaksacijom i metodom generacije stupaca. Kako je upravo metoda generacije stupaca najvažniji rezultat za rješavanje našega problema, napredniji rezultati vezani uz određivanje donjih i gornjih granica su detaljno objasnjeni. U posljednjem, trećem poglavlju, nalazi se model za prikazivanje problema rasporeda vožnje za mreže s jednom tračnicom. Navedeni model prvi puta je predstavljen u doktorskom radu Valentine Cacchiani. U ovom radu također pretpostavljamo periodičnost rasporeda vožnje kako bismo, između ostalih, ostvarili prednost poput bržeg vremena računanja. Na kraju rada nalazi se algoritam, temeljen na metodi generacije stupaca, za rješavanje predstavljenog modela. Navedeni algoritam sastoji se od 6 koraka, od kojih je svaki detaljno opisan u ovome radu

Network optimization in railway transport planning

This work is dealing with train timetabling problem. In the first chapter, one can find an introduction to network flows which is needed for understanding deeper concepts later on. Namely, basic graph theory definitions are stated as well as core problems like the minimum cost flow and shortest path problem. Furthermore, two equivalent representations of network flows are described, including some useful properties connected to each of them. At the end of the chapter, linear programming and simplex method are introduced into some detail. In the second chapter more complex theory is introduced. At the beginning, multi-commodity flow problem is stated and few solutions approaches are briefly described. Once we settled for one of them, the rest of the chapter is dealing with Lagrangian relaxation and column generation techniques. Since column generation is the main result needed for solving our problem, some finer results, like determining lower and upper bounds, are stated. In the last, third chapter, one can find a model for representing train timetabling problem for a single line network. That model was introduced by Valentina Cacchiani in her Ph.D. thesis. In this work, periodicity of timetable is assumed because it makes computations way quicker, as well as it has some other benefits. At the end, one can find an algorithm based on column generation technique for solving introduced model. That algorithm is based on 6 steps, and after reading this work, one should be able to fully understand each of them.Ovaj rad bavi se problemom rasporeda vožnje u željezničkom prometu. U prvom poglavlju nalazi se uvod u mrežne tokove koji je potreban za razumijevanje naprednijih koncepata. Konkretno, iskazane su osnovne definicije teorije grafova kao i neki temeljni problemi poput problema najjeftinijeg toka i problema najkraćeg puta. Nadalje, opisana su dva ekvivalenta prikaza mrežnih tokova, uključujući neka korisna svojstva za svaki od njih. Na kraju poglavlja, linearno programiranje i simpleks metoda, objašnjeni su na razini razumijevanja. U drugom poglavlju nalazi se naprednija teorija koja se nadovezuje na prvo poglavlje. Na početku poglavlja prikazan je problem više dobara, kao i nekoliko pristupa rješavanju navedenog problema. Nakon što smo se odlučili za jedan od pristupa, ostatak poglavlja bavi se Lagrangeovom relaksacijom i metodom generacije stupaca. Kako je upravo metoda generacije stupaca najvažniji rezultat za rješavanje našega problema, napredniji rezultati vezani uz određivanje donjih i gornjih granica su detaljno objasnjeni. U posljednjem, trećem poglavlju, nalazi se model za prikazivanje problema rasporeda vožnje za mreže s jednom tračnicom. Navedeni model prvi puta je predstavljen u doktorskom radu Valentine Cacchiani. U ovom radu također pretpostavljamo periodičnost rasporeda vožnje kako bismo, između ostalih, ostvarili prednost poput bržeg vremena računanja. Na kraju rada nalazi se algoritam, temeljen na metodi generacije stupaca, za rješavanje predstavljenog modela. Navedeni algoritam sastoji se od 6 koraka, od kojih je svaki detaljno opisan u ovome radu

Network optimization in railway transport planning

This work is dealing with train timetabling problem. In the first chapter, one can find an introduction to network flows which is needed for understanding deeper concepts later on. Namely, basic graph theory definitions are stated as well as core problems like the minimum cost flow and shortest path problem. Furthermore, two equivalent representations of network flows are described, including some useful properties connected to each of them. At the end of the chapter, linear programming and simplex method are introduced into some detail. In the second chapter more complex theory is introduced. At the beginning, multi-commodity flow problem is stated and few solutions approaches are briefly described. Once we settled for one of them, the rest of the chapter is dealing with Lagrangian relaxation and column generation techniques. Since column generation is the main result needed for solving our problem, some finer results, like determining lower and upper bounds, are stated. In the last, third chapter, one can find a model for representing train timetabling problem for a single line network. That model was introduced by Valentina Cacchiani in her Ph.D. thesis. In this work, periodicity of timetable is assumed because it makes computations way quicker, as well as it has some other benefits. At the end, one can find an algorithm based on column generation technique for solving introduced model. That algorithm is based on 6 steps, and after reading this work, one should be able to fully understand each of them.Ovaj rad bavi se problemom rasporeda vožnje u željezničkom prometu. U prvom poglavlju nalazi se uvod u mrežne tokove koji je potreban za razumijevanje naprednijih koncepata. Konkretno, iskazane su osnovne definicije teorije grafova kao i neki temeljni problemi poput problema najjeftinijeg toka i problema najkraćeg puta. Nadalje, opisana su dva ekvivalenta prikaza mrežnih tokova, uključujući neka korisna svojstva za svaki od njih. Na kraju poglavlja, linearno programiranje i simpleks metoda, objašnjeni su na razini razumijevanja. U drugom poglavlju nalazi se naprednija teorija koja se nadovezuje na prvo poglavlje. Na početku poglavlja prikazan je problem više dobara, kao i nekoliko pristupa rješavanju navedenog problema. Nakon što smo se odlučili za jedan od pristupa, ostatak poglavlja bavi se Lagrangeovom relaksacijom i metodom generacije stupaca. Kako je upravo metoda generacije stupaca najvažniji rezultat za rješavanje našega problema, napredniji rezultati vezani uz određivanje donjih i gornjih granica su detaljno objasnjeni. U posljednjem, trećem poglavlju, nalazi se model za prikazivanje problema rasporeda vožnje za mreže s jednom tračnicom. Navedeni model prvi puta je predstavljen u doktorskom radu Valentine Cacchiani. U ovom radu također pretpostavljamo periodičnost rasporeda vožnje kako bismo, između ostalih, ostvarili prednost poput bržeg vremena računanja. Na kraju rada nalazi se algoritam, temeljen na metodi generacije stupaca, za rješavanje predstavljenog modela. Navedeni algoritam sastoji se od 6 koraka, od kojih je svaki detaljno opisan u ovome radu

Safe Model-Based Multi-Agent Mean-Field Reinforcement Learning

Many applications, e.g., in shared mobility, require coordinating a large number of agents. Mean-field reinforcement learning addresses the resulting scalability challenge by optimizing the policy of a representative agent. In this paper, we address an important generalization where there exist global constraints on the distribution of agents (e.g., requiring capacity constraints or minimum coverage requirements to be met). We propose Safe-$\text{M}^3$-UCRL, the first model-based algorithm that attains safe policies even in the case of unknown transition dynamics. As a key ingredient, it uses epistemic uncertainty in the transition model within a log-barrier approach to ensure pessimistic constraints satisfaction with high probability. We showcase Safe-$\text{M}^3$-UCRL on the vehicle repositioning problem faced by many shared mobility operators and evaluate its performance through simulations built on Shenzhen taxi trajectory data. Our algorithm effectively meets the demand in critical areas while ensuring service accessibility in regions with low demand.Comment: 25 pages, 14 figures, 3 table

A review of real-time railway and metro rescheduling models using learning algorithms

Planning railway and metro systems includes the critical step of finding a schedule for the trains. Although buffer times and running supplements are added to the schedule to make operations resilient to minor disturbances, they do not protect against all possible events that may lead to conflicts during everyday operations. Thus, real-time train rescheduling models are needed to restore feasibility using actions such as retiming, reordering, rerouting, overtaking or cancelling of trains. Unfortunately, despite many rescheduling models that have been developed in the literature, only a few can learn actions from past, simulated, or ongoing events and cope with disturbances and disruptions’ stochastic nature. However, the last decade’s expansion of learning algorithms is gaining momentum in the train rescheduling literature by bringing promising novel ideas. This paper aims to review the state-of-the-art learning algorithms applied to the real-time railway and metro rescheduling, identifying challenges and opportunities while making a parallel with other areas where learning algorithms led to breakthroughs

Safe model-based multi-agent mean-field reinforcement learning

Many applications, e.g., in shared mobility, require coordinating a large number of agents. Mean-field reinforcement learning addresses the resulting scalability challenge by optimizing the policy of a representative agent. In this paper, we address an important generalization where there exist global constraints on the distribution of agents (e.g., requiring capacity constraints or minimum coverage requirements to be met). We propose Safe-$\text{M}^3$-UCRL, the first model-based algorithm that attains safe policies even in the case of unknown transition dynamics. As a key ingredient, it uses epistemic uncertainty in the transition model within a log-barrier approach to ensure pessimistic constraints satisfaction with high probability. We showcase Safe-$\text{M}^3$-UCRL on the vehicle repositioning problem faced by many shared mobility operators and evaluate its performance through simulations built on Shenzhen taxi trajectory data. Our algorithm effectively meets the demand in critical areas while ensuring service accessibility in regions with low demand